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A  note  on  Smale’s  Global  Newton  Method 

A.  A.  Goldstein* 


We  have  previously  considered  Smale’s  [1]  global  Newton  method  in  conjunction  with 
the  Kantorovich  inequalities  in  a  simple  setting.  Our  object  was  to  determine  a  class  of 
problems  for  which  the  method  could  be  expected  to  be  efficient.  We  now  repeat  this 
project  using  Smale’s  [2]  estimates  at  one  point  instead  of  the  Kantorovich  estimate. 

The  power  of  Smale’s  estimate  stems  not  only  from  the  fact  that  the  information  is  con¬ 
centrated  at  one  point.  A  further  advantage  is  that,  in  contrast  with  the  Kantorovich 
inequalities,  no  estimate  of  the  norm  of  the  inverse  of  the  derivative  opeiatur  by  itself  is 
needed.  Newton  step  lengths  can  be  small  even  if  the  derivative  operator  is  nearly  singular. 


The  algorithm  below  requires  only  local  information  for  its  implementation.  To  predict  its 
behaviour,  however,  certain  global  constants  are  needed.  These  constants  can  be  estimated 
on  a  thin  cylinder  containing  a  segment  joining  the  origin  and  the  initial  value  of  the  vector 
valued  function  for  which  wc  are  seeking  the  root.  The  iteration  count  for  the  algorithm 
is  sensitive  only  to  the  parameter  j~;  defined  below. 

Theorem  1  (Smale  86  )  Assume  F  is  an  analytic  map  between  real  Banach  spaces  X 

and  Y.  That  is,  the  Frechet.  derivatives  FUl(r)  exist  for  all  x  €  X  and  k— 1.2,3 . Given 

To  £  X.  assume  that  the  inverse  of  F'(.r).  which  we  denote  by  Flj(x),  exists.  Set 


d(x0)  =  ||Fl1(.r0)F(.ru)||  and 

*>Uo)  -  >vp^\\l~[FL1{T0)F(k\T0)\\^  :  k  >  2 1 


If 


i(.r0)7(x0)  <  .130707 

then  Xu  is  an  approximate  root  of  F.  That  is  the  Newton  sequence 


1  =  xk  ~  FLl(xk)F(xk) 

is  well  defined  and  {.r^}  converges  to  say  <f,  a  root  of  F  at  the  rate: 

lk*+i  ~  -rfc|l  <  2(J)2  J3(x0) 

*  supported  by  grants  NIH  RR01243-05  AND  NFS  LMC-M4E1 


o 


Moreover, 


h-tll  <  J(^)2‘"‘«x„) 

The  next  result  is  not  given  by  Smale  but  it  is  readily  calculated  using  his  ingredients.  In 
what  follows  we  shall  often  abbreviate  (3(xk )  (and  similar  expressions)  by  j3k. 

Remark  2 

||F'(r,)||  <  1.85  ||F'(r0 ))|  A:  =1,2,3, . 


Proof.  In  [2],  Proposition  2,  we  find  the  formula 

+  l  2:  ak  /(2o|  —  4ait  +  1). 


where  a k  ~  dr- 7 k  <  1/S.  Then  or+i  <  (2  or)2.  In  Sinale’s  proof  of  Lemma  2  we 
find  ||  I  -  F'_}(Xk)F'(.rk+1 )  ||  <  (1-  at)-2  -  1.  Whence  ||  J  -  FL^r*  )F'(r t+i  ) !!  < 
1  -f  (11/4)  or-  Let  Hk  =  FL,  ( xk  )F'(xk+] )  then  F'(  xk+] )  =  F'{xk)  Hk.  and 


k 

||F'(^+1)||  <  |IF'(r0)||  n<>  +  (11/4)  (2  oo)2' ) 

«=o 


We  can  improve  this  result  by  using  sharper  bounds  for  i=0  and  for  i  =  l.  namely,  .306 
and  .138.  respectively.  Then 


fl(l  +  ( 11/4)  (2 o0 )2' 


yOC 

<  (11/4)  I  (1/4 )2\ir  <  .172 


Finally  we  have  the  estimate 

nn^ii  <  l85- 

»=0 


Assume  the  hypotheses  of  Theorem  1.  Let 


F={r€A':||F(r)||  <  ||F(r0)||}. 


We  assume  that  7 (.r).  F(.r)  and  d(.r)  are  defined  and  can  be  calculated  throughout  T. 
Assume  the  existence  of  numbers  ,1.  7.  K  and  a  that  bound  d(.r),  7(.r).  ||F'(r)||  and 


rr[.r)  =  ||F(_,(.r ) 


F(.r) 
II  F(  x) 


3 


on  T.  Let  ]x[  denote  the  smallest  integer  >  x. 

Algorithm  3  Given  r,  £  T,  we  define  xI+i  as  follows.  Set  t,  =  1  —  (87,/?!  )_1 ,  where 
~U  =  7 (x,)  and  /?i  is  defined  similarly.  Set  ^  ~  x,  and  run  the  Newton  sequence  for  G 
starting  at  £'0.  Let  k  be  the  smallest  integer  satisfying 

GUI)  <  ||F(z,)||/407,/?. 


Set  x,+  i  =  ££. 


The  algorithm  can  be  run  and  terminated  with  a  posteriori  data,  without  any  knowledge 
of  the  values  of  the  constants  j3.  7,  cr,  and  K.  Moreover  to  verify  a)  and  b)  below  we  do 
not  use  these  constants.  However  the  global  behaviour  of  the  algorithm  els  described  in  c) 
and  d)  is  given  in  terms  of  these  constants.  Let  I\,  —  1.85  ||F(x,)||. 


Claim  4 


(a)  xl+1  can  be  found  in  S  =  j  log2  (log2  (SO  A',  7,  d,2  /  ||F(x,)j| ))[  steps. 

(b)  ||F(xI+1)||<  (1  -  (I/IO7.&))  l!F(x,)|| 

(c)  Let  S  =  log2(log2(80  A'  7  da)).  Given  e  >  0,  if  k  >  ]10  ^jdS  log2(  l/e)[ 
then  (!iF(xfc)  /j|F(x0))  <  t. 

(d)  If  k  >  ]10  7,d51og(8vcr)[  then  x*  is  an  approximate  root  of  F. 


Proof.  We  show  first  that  x,  +  i  can  be  chosen  as  claimed.  Let  G'(x)  =  f ,F(x, ).  Then 
x,  is  an  approximate  root  for  G' .  Hence  if  £0  =  G  and  ik+\  =  ik  ~  F' [ik)G{ik)  then 
£jt .  converges  to  G  •  a  root  of  G' .  We  now  prove  (b) 

We  have  that  G’(x,)  -  G‘(G)  =  G'(x,)  =  (F(x,)/8/?, 7,)  =  F(x,)-F(£,).  Also. 
F(x,)  —  F(x,+) )  =  F(xt)  —  F(G)  +  G'(C)  -  G'(x,+i)  =  (F(xi)/S/?,7i)  +  <?*(£')  - 
G"(x,+  i ).  Thus  b)  is  true. 

We  now  prove  a)  by  counting  the  steps  needed  to  ensure  that 
||G'(£')|i  <  l!F(x,  )||  /407,d,  =  imp.  Since  (?'(£,)  =  F'(£,)  (G+i  -  s.) 
we  may  choose  k  to  ensure  that  2  K'(^)2  0(x,)  <  tmp 

To  prove  c)  replace  id,  and  7,  by  $  and  7,  respectively.  If  k  satisfies 
k  log2(l  -  (1  /  10  7/?))  <  f  then  (||F(xjt)||  /  ||F(.r0)||)  <  f- 
To  go  from  k  to  k  +  1  requires  no  more  than  S  steps. 
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We  now  turn  to  d).  If  ||.F(r)||  <  then  x  is  an  approximate  root  for  F.  Thus  we 

replace  1  /  c  in  c)  by  Sap 


Remarks  5 

The  method  is  sensitive  only  to  the  number  7 (J  ! 

Note  that  from  the  above  proof  F(£')  =  t,F(x,).  Since  xt+i  lies  near  £'  the  global 
constants  need  be  estimated  only  on  a  slender  tube  surrounding  the  segment  joining  the 
origin  and  F(xq). 
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